Energy dissipation and violation of the fluctuation-response relation in 
non-equilibrium Langevin systems 
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The fluctuation-response relation is a fundamental relation that is applicable to systems near 
equilibrium. On the other hand, when a system is driven far from equilibrium, this relation is 
violated in general because the detailed-balance condition is not satisfied in nonequilibrium systems. 
Even in this case, it has been found that for a class of Langevin equations, there exists an equality 
between the extent of violation of the fluctuation-response relation in the nonequilibrium steady 
state and the rate of energy dissipation from the system into the environment [T. Harada and 
S. -i. Sasa, Phys. Rev. Lett. 95, 130602 (2005)]. Since this equality involves only experimentally 
measurable quantities, it serves as a proposition to determine experimentally whether the system 
can be described by a Langevin equation. Furthermore, the contribution of each degree of freedom 
to the rate of energy dissipation can be determined based on this equality. In this paper, we present 
a comprehensive description on this equality, and provide a detailed derivation for various types 
of models including many-body systems, Brownian motor models, time-dependent systems, and 
systems with multiple heat reservoirs. 

PACS numbers: 05.40.Jc, 05.70.Ln, 87.16.Nn 



I. INTRODUCTION 

In equilibrium statistical mechanics, the thermody- 
namic properties of a system in contact with a heat bath 
can be described in terms of the dynamical degrees of 
freedom x instead of a complete set of variables of the 
system and heat bath (x, T). It is also widely accepted to 
describe a system in terms of effective variables x along 
with an effective Hamiltonian H(x) in which the con- 
tribution of the remaining variables Y are renormalized. 
By appropriately selecting effective variables x, we can 
study the universal features of a system p|. 

Similarly, in order to describe a system under a 
nonequilibrium condition, it may be reasonable to de- 
termine a closed description in terms of a part of the 
degrees of freedom x instead of considering the entire set 
of variables (a;,r). In this case, since we should consider 
the dynamics of the selected variables, such a reduction 
in the degrees of freedom requires the following strong as- 
sumption: (Al) The typical time scale t x of the selected 
variables x is considerably larger than the time scale Tp of 
the remaining variables T. This assumption implies that 
there exists a time scale At such that Tr <C At <C t x . 
When this condition is satisfied, the time evolution of 
the variables x with a time interval of At is described as 
a Markovian stochastic process; in particular, a Langevin 
equation is obtained in the limit At/r x — ► The 
contribution of the eliminated degrees of freedom T is in 
part renormalized into an effective Hamiltonian, and is in 
part decomposed into dissipation and noise terms of the 
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Langevin equation characterized by a friction coefficient 
7 and the noise intensity M, respectively. 

Although condition (Al) is sufficient to describe the 
dynamical properties of the effective variables, it is in- 
sufficient to account for the thermodynamic properties 
of the system of x, particularly, the energetics. In other 
words, condition (Al) alone does not guarantee that the 
eliminated degrees of freedom can be regarded as a heat 
bath for the system of x. To clarify this fact, let us 
consider a simple example Consider that a colloidal 
particle suspended in an aqueous solution of tempera- 
ture T is subjected to a periodic potential and constant 
driving force. With regard to the long-time behavior of 
the particle, we can obtain an effective description ex- 
pressed as a Langevin equation with effective friction co- 
efficient 7 and noise intensity M. However, in such a 
description, it is found that M ^ jT, thereby implying 
that the second kind of the fluctuation-dissipation the- 
orem cannot be applied naively in contrast to the equi- 
librium case (the Boltzmann constant is set to unity). 
This is because the eliminated variables, which include 
the short-time motion of the particle itself, are also af- 
fected by the driving force. In such a case, it becomes 
difficult to identify the boundary between the system and 
the heat bath, and we cannot accurately determine the 
amount of energy transferred between x and T. In order 
to avoid this difficultly, we require another assumption: 
(A2) The nonequilibrium condition imposed on the sys- 
tem of x does not directly affect the eliminated degrees of 
freedom T. Based on assumptions (Al) and (A2), we can 
consider that the eliminated variables are quickly equi- 
librated at a temperature T when no energy is trans- 
ferred between x and T. When the system of x exerts a 
force on the eliminated degrees of freedom, the reaction 
to the system of x can be characterized with the linear- 
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response properties of the eliminated variables, such as 
the friction coefficient 7. In particular, when the system 
dynamics are described by a Langevin equation, assump- 
tion (A2) relates M to 7 and T according to the second 
kind of the fluctuation-dissipation theorem: M = jT. It 
should be noted that assumption (A2) corresponds to the 
local detailed-balance condition, which is regarded as a 
key property of stochastic processes for describing non- 
equilibrium steady states, since M = 7T is derived by 
imposing this condition on a Langevin equation with 7 
and M. 

In systems under equilibrium conditions, the deriva- 
tion of the Langevin equation from a classical mechani- 
cal system was formulated by employing the projection- 
operator method 0,E1j0- However, for nonequilibrium 
conditions, there is no satisfactory theory that provides 
the foundation for the Langevin equation on the basis 
of a mechanical system. This is because it is difficult to 
treat persistent energy transfer from the degrees of free- 
dom x to the degrees of freedom T mathematically. Thus, 
the use of a Langevin equation to describe the dynam- 
ics of a nonequilibrium system in general is not justified, 
although a Langevin-type model is phcnomcnologically 
employed in many cases. 

Based on this background, it is extremely important to 
experimentally validate such an effective description for 
nonequilibrium systems, i.e., validate assumptions (Al) 
and (A2). For instance, consider the description of the 
above-mentioned system comprising a colloidal particle 
suspended in an aqueous solution. We assume that an 
external force is exerted to drive the colloidal particle. 
In this case, x represents the position of the center of 
mass of the particle as x = (xo, X\,X2), and F is defined 
such that (x,T) represents all positions and conjugate 
momenta of atoms constituting the particle and the so- 
lution in an adiabatic container. Static effects of the 
solvent can be incorporated in the effective Hamiltonian 
H{x). With these variables, it might be plausible to ac- 
cept the assumptions (Al) and (A2). However, even in 
such a simple case, their validity for a non-equilibrium 
state can be justified only with experimental confirma- 
tion. 

This approach might be considered to be very strict. 
However, when a system becomes more complicated, we 
must be very careful while accepting the validity of an 
effective description. For example, in the past decade, 
many attempts have been made to describe the motion 
of a biological motor protein in terms of several effective 
variables using a Langevin-type stochastic model, termed 
Brownian motor model 8, 9]. On the other hand, by con- 
sidering the complex structure of the protein molecule, 
there is no definite reason to select a certain variable as 
an effective one from many internal degrees of freedom 
of the molecule. Therefore, it is useful to establish a cri- 
terion to determine experimentally whether the degrees 
of freedom selected in a model satisfy assumptions (Al) 
and (A2). 

For this purpose, we need a proposition to validate 



assumptions (Al) and (A2) experimentally. A propo- 
sition is favorable when it docs not include any fitting 
parameters and involves quantities for explicit measure- 
ments. Further, the best proposition for this purpose is 
the one that can be rigorously proved in a general class 
of Langevin-type models that satisfy assumptions (Al) 
and (A2). This is because the experimental examination 
of this proposition will allow us to validate assumptions 
(Al) and (A2) directly. 

In order to formulate such a proposition, we determine 
certain experimentally measurable quantities. In particu- 
lar, we consider the nonequilibrium steady state of a sys- 
tem comprising several colloidal particles suspended in a 
solution under a nonequilibrium condition. We select the 
spatial coordinates of the center of mass of the particles 
as the effective variables x = (xq,x±,--- , xjv-i)- The 
basic statistical quantities are the steady current defined 
as 

Vi = {±i(t)) , (1) 

and the correlation function of velocity fluctuations 

^^^([^^-^[^(O)-^])^ (2) 

where (• • -) represents an ensemble average for the non- 
equilibrium steady state. 

Evidently, Vi and dj (t) depend on system details such 
as an interaction potential between the particles. In or- 
der to compare the experimental result with the com- 
puted value for a theoretical model, it is essential to tune 
the parameter values of the theoretical model. Thus, the 
determination of only Vi and Cij (t) is insufficient for val- 
idating the effective description. 

In order to obtain more information on the sys- 
tem, let us apply a small perturbation force ef p (t) = 
e(/o(t), /f (t), • • • , f^ I _ 1 {t j) to it. If its magnitude is suf- 
ficiently small (e < 1), we can expect that x will linearly 
respond to the perturbation as 

N-i .t 

(Xi{t)) e -Vi = £ E / Rij(t-s)ff(s)ds + 0(e 2 ), (3) 

in the limit e — ► 0, where (• • •) represents the ensemble 
average in the presence of the perturbation force. Rij(t) 
is termed the response function. 

According to the fluctuation-dissipation theorem [To| . 
if the system is in equilibrium, the response function 
carries the same information as the correlation function. 
This equivalence is expressed by the relation 

C tJ {t) =TR ij (t) for t>0, (4) 

which (termed "the fluctuation-response relation" here- 
after) can be proved by assuming that the system satisfies 
the detailed-balance condition. A noteworthy feature of 
the fluctuation-response relation is that it is closed only 
with experimentally measurable quantities. Hence, the 
experimental determination of Cij (t) and R\j (t) enables 
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us to verify whether the system satisfies the detailed- 
balance condition. 

For the non-equilibrium steady state in which the 
detailed-balance condition is not satisfied, it is known 
that the fluctuation-response relation of Eq. J3J is vi- 
olated 1,111110. It should be noted that the 
response function defined in Eq. Q characterizes the 
linear-response property of the nonequilibrium steady 
state and not that of the equilibrium state. Therefore, 
the measurement of the response function provides infor- 
mation that differs from that of the correlation function. 
However, since Rij(t) also depends on the system details, 
it is unsuitable for validating the effective description. 

In such a case, if the violation can be expressed in a 
universal form, it is expected that this form may measure 
the "distance" of the nonequilibrium system from equilib- 
rium. Recently, it has been proved that a nonequilibrium 
Langevin model that satisfies (Al) and (A2), the extent 
of the violation is related to the rate of energy dissipation 
into the heat bath (J) by an equality [14j. According 
to this theory, the following equality holds provided the 
evolution of x is determined by a Langevin equation: 



N-l 



(J)o = £7* 



i=0 





pOO 












J — GO 



C ii (oj)-2TR' ii (u>) 



1 dto 
2^ 



, (5) 

where 7$ denotes the friction coefficient of Xi(t); Cij(tv) 
and Rij(u>) represent the Fourier transforms of Cij(t) 
and Rij(t), respectively. Similarly, the Fourier trans- 
form of an arbitrary function A(t) is denoted by A(uj) = 
A(t)ev~^- ut dt; the prime denotes the real part. In 
general, when the dynamics of x(t) are overdamped, 
7~ 1 = lim^^oo Rii(uj) holds. It should be noted that 
the right-hand side of Eq. (JSJ) represents the extent of 
violation of the fluctuation-response relation. 

Next, we show that Eq. © qualifies as the best propo- 
sition for experimental examination in order to investi- 
gate the validity of the effective description based on as- 
sumptions (Al) and (A2). First, it is evident that Eq. (JSJ) 
represents a closed relation among experimentally mea- 
surable quantities, without a fitting parameter. More- 
over, ( J) can be obtained by measuring the input energy, 
because in the nonequilibrium steady state, energy is ex- 
ternally injected at a constant rate and dissipated into 
the environment at the same rate. Second, as shown in 
Ref. 0|> Eq. (0) holds for systems far from equilibrium, 
when the evolution of x is described by a Langevin-type 
model. The equality is independent of the other details 
of the model. Therefore, it enables quantitative exami- 
nation of the relevance of a Langevin-type model to the 
system under investigation. 

Since a few simple examples were addressed in 
Ref. we provide a detailed description of the equal- 
ity for several Langevin models of physical interest. In 
the following sections, we analyze many-body systems 
with and without inertia terms, stochastically or period- 
ically driven systems, and systems in contact with mul- 



tiple heat reservoirs. We will show that it is possible to 
obtain a similar result for the relation between the dissi- 
pation rate and the extent of violation of the fluctuation- 
response relation irrespective of the model details. Fur- 
ther, we suggest a possible experimental study on this 
issue. 

This paper is organized as follows. In Sec. [HJ a 
Langevin model with many degrees of freedom is intro- 
duced as an example. Then, Eq. JSJ is proved for this 
model with and without the inertia terms, followed by 
several remarks. In Sec. IIIII generalized forms of Eq. 
(JSJ) are proved for other cases, such as a model with a 
stochastically switching force, a model driven by a time- 
dependent external force, and a model that includes mul- 
tiple heat reservoirs. Concluding remarks are provided in 
Sec. El along with a suggestion of experimental studies 
related to this topic and future theoretical problems. The 
proof of the fluctuation-dissipation theorem for Langevin 
systems under equilibrium is provided in Appendix^ In 
Appendix [5] Eq. © is derived for the case of a single 
variable by using a path-integral argument. Finally, in 
Appendix [UJ the proof of a technical lemma used in the 
proof in Sec.^is provided. 



II. MANY-BODY LANGEVIN SYSTEMS 

In this section, Eq. JSJ is derived for a Langevin 
model with many variables. In particular, a model of 
colloidal suspension under non-equilibrium conditions is 
studied, although the argument can be applied to various 
Langevin systems of many variables. The model and its 
energetic interpretation are explained in Sec. Ill Al Then, 
we present the mathematical proofs of Eq. (JSJ) for cases 
with and without the inertial terms in Sees. Ill Bl and III CI 
respectively. In Sec. Ill Dl we comment on the result. 



A. Model 

We consider a three-dimensional system that com- 
prises n = N/3 spherical particles suspended in an 
aqueous solution. For this system, we adopt as- 
sumptions (Al) and (A2) as mentioned in Sec. [I] by 
considering the positions and velocities of the center 
of mass of the particles as the effective variables. 
The three-dimensional position and velocity of the 
/i th particle are denoted by r M = , , rj^ ) and 
tip = (u^, up, up), respectively, where fi = 0, 1, • • • , n— 1. 
Hereafter, we collectively denote the positions and 
velocities of the particles as a; = (xo, ■ ■ ■ , xn-i) = 

'Oi'Oi'Oj f'jLii'/j' A" ' 'n-li ' n-Xi ' n-l) 

and v = (v Q ,- ■ ■ ,v N -i) = 

(u , u , u , ■ ■ ■ , 11^, u^, u^, ■ ■ ■ ,u n _ 1 ,u n _ 1 ,u n _ 1 ), re- 
spectively. 

Based on assumption (Al), the motion of the particles 
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is described by the Langevin equations 

Xi{t) = Vi(t) 



(6) 



mtVi(t) = -TifiW + ^i^WJ+CiW+e/fWi (7) 

where i = 0, • • • , JV — 1. In this case, rrii and 7* represent 
the mass and friction cocfhcicnt of the particle, 
respectively, where \_a\ represents the largest integer that 
is not larger than a. Further, based on assumption (A2), 
(t) is the zero- mean white Gaussian noise that satisfies 



(6(t)&(tO>=27<TM(*-0 



(8) 



The last term on the right-hand side of Eq. J7J represents 
a probe force on the i th coordinate with < e -C 1. An 
initial condition is imposed at t = to, and we consider 
statistical quantities in the limit to — > — oo. 

The second term Fi(x) on the right-hand side of Eq. @ 
represents the force acting on the i th coordinate. For 
example, consider a system of colloidal particles trapped 
in an optical potential; a constant driving force /e*o is 
applied to them (see Ref. |l5|). This system may be 
described by selecting Fi(x) as 



2,3/1 



p=0 



_d_ 

dx, 



n-1 



n=0 



gg j^&zM , (9) 



dx 



u=0 v=0 



lh 



where V^if) represents an optical potential of the \x 
particle and V^„(|r|) is an interaction potential between 
the /it th and v th particles. Similarly, for a system of col- 
loidal suspension under shear flow described by u(f) = 
kf, where k is a constant shear rate tensor, we can select 
Fi(x) as 

n-1 2 2 
Fi(x) = E E E <W+g)«W r £' 

H=0 q=0 g'=0 

-w^ v " ( \ fA) ' < 10 > 

! M= o i/=0 

I 



For a detailed analysis on the behavior of this model, see 
Ref. 

Therefore, the model described by Eqs. © and Q 
can exhibit various phenomena of many-body Langevin 
systems; the following argument does not depend on 
the form of the selected force term Fi(x). However, it 
should be noted that the effect of hydrodynamic inter- 
action between the particles is not included in Eqs. © 
and 0. Hence, the phenomena described by the model 
in these equations are rather ideal. This might be justi- 
fied when the mean distances between the particles are 
sufficiently large such that hydrodynamic correlation can 
be neglected. In general, since there are several methods 
for including the effect of hydrodynamic interactions be- 
tween particles [rjj, this problem will be addressed else- 
where. 

Let us define the measurable quantities of this system. 
Steady currents, velocity correlation functions, and re- 
sponse functions are already defined in Eqs. Q, j^), and 
P|l , respectively. It is well known that when the system is 
in equilibrium, i.e., / = in the case of Eq. @ and k = 
in the case of Eq. (JTUJ, the fluctuation- response relation 
described in Eq. Q holds. This will be demonstrated in 
Appendix ^ On the other hand, when the force terms 
contain nonconservative parts, the fluctuation-response 
relation is violated in steady states. 

Next, we define the rate of energy dissipation according 
to K. Sekimoto's argument 0. As discussed in Ref. [l8| . 
it is natural to define the energy dissipated through the 



coordinate during an infinitesimal interval At as 



Ji(t)At 



t+At 



[liVi(s) - £i(s)] o dxi(s), (11) 



where the symbol o denotes the multiplication in the 
sense of Stratonovich The total rate of dissipation 
is the sum of Ji(t)'s as J(t) = J^iLo 1 Using the 

Stratonovich calculus, it is easy to show that this defini- 
tion of the dissipation complies with the energy conser- 
vation law. For instance, in the case of the force model 
represented by Eq. (O, by summing Eq. pif) over i and 
setting e = 0, we obtain 



pt+At 

J(t)At = - d£ 

Jt u=0 



m 3a 



n-1 



V(|fv(s) - rv( S )|) 



i/=0 

I — 



n-1 



E(/e ,tv(i))At. (12) 

fi=0 



Since the first and second terms on the right-hand side 
of Eq. I|12l) represent the change in the mechanical en- 
ergy of the particles and the amount of energy input by 
the constant driving force, respectively, this equation ex- 
presses energy conservation by interpreting Ji(t) defined 



in Eq. <f 1 1 1> as the energy dissipated into the heat bath 
through the i th degree of freedom. Furthermore, the 
identification of energy dissipation in this manner was 
shown to agree with the second law of thermodynamics 
0. 
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B. Proof: Underdamped case 

With this background, we prove the main result in 
Eq. JSJ. First, let us express Eqs. JJJJ and (7J in mathe- 
matical forms: 



where Wi(t) denotes a Wiener process 0; Wi(t) and 
Wj(t) are assumed to be uncorrelated when i ^ j. Us- 
ing the Ito formula, the time derivative of an arbitrary 
function A(x(t), v(t)) is calculated as 



dxi(t) = Vi(t)dt (13) 

«Mt) = -T«(^^(^w) dt + yg dfi(f) 



III; 



dt, 



(14) 



7V-1 



dA{x(t),v(t)) = ^Vi(t)—A(x(t),v(t))dt 

i=0 
N-l 

E 



i=0 
iV-1 



dx 

nvi{t) + (»(<)) a 



,^(*(t)Xi)) + |||^(*(*)X*)) 
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i=0 



___^dWi(t) + — /f(i)di 
m,- m,- 



(15) 



where c? Xi A(a?(t) , t^(i)) represents d Xi A(x,v) evaluated 
at (x,v) = (x(t),v(t)). A similar convention is used 
throughout this paper. The symbol • denotes multipli- 
cation in the sense of Ito In conventional notation, 
Eq. {T5)| can be rewritten as 



—A(x{t),v(t))=AA(x(t),v(t)) 
at 



N-l 



where 

N-l r 

a-E 

i=0 



i=0 



_9_ 



E ^(*(*),«(*)) 



&(*) + e/< p (*) 



m? dv 2 



dvi 



(16) 



(17) 



is the backward Kramers operator. A solution of Eq. I |16(l 
can be expressed in the form 

A(x(t), v(t)) = g(t)A(x(t ),v(t )), (18) 

where the operator Q(t) is independent of A(x,v). By 
substituting Eq. H18|l into Eq. (|16fl , we obtain a stochastic 
differential equation for Q{t) as 

N-l 



dg(t) 
dt 



with the initial condition, Q(to) 
of Eq. (|19fl is expressed as 



1. A formal solution 



Q(t) = e^) A + f* Y <?( s )A e (*-)A. ZM±llM ds . 



(20) 



By identifying A(a;,t>) = Fi(x) in Eq. I|18|) and using 
Eq. (|2U|) . we obtain 

^(t)) = e^^O^io)) (21) 
+ / E fe(s)+£/f(s)]d S) 



where 







e tA ^ ( (a;) for t > 
for f < 



(22) 



By substituting Eq. ill' 21) into Eq. J7J) and averaging it 
with e = 0, it is shown that 



lim ^ t - to ^F l {x{t )) = ll 

to — > — oo 



(23) 



since the left-hand side does not depend on t. Hereafter, 
the limit to — ► — oo will be considered. 
The formal integration of Eq. Q yields 

Vi (t)= [ H i (t-s)-[F i (x(s))+Z i (s)+ef?(s)]ds, 



where 



_ e -7it/ mi {ort> Q 







for t < 



(24) 



(25) 
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By using Eq. l(2*2*Jl. we rewrite Eq. ((2"4"|l as 



C. Proof: Overdamped case 



Vi(t) - v 

rt W-l 



(26) 



where 



/>oo 

JQj(t, a;, w) ee / Hi(a)$ij(t - s, x, v)ds + 
Jo 

(27) 

Therefore, the average of Eq. l(2Tjl is expressed as 



(vi(t)) e -v. 

,t N-l 



+0(£ 2 ). 



(28) 



Since Eq. I|28|) holds irrespective of the functional form 
of fi(t), by comparing Eqs. J3J and l|28|). we obtain 

i?y(t-s) - (ITy (*-«,*(*),«(*)))„. (29) 

Next, Eq. 1(11(1 is rewritten as 



Ji{t)M 



7i w 2 (s) 2 ds - V2t^w 4 (s) o dW l (s) 



Now, we set e = 0. By using the lemma described in 
Appendix O Eqs. (23 and (gDJ lead to 



7.r 



o dWi(«)> = lim ^ ^-^(s)d S (31) 



By definition, since i?^ (i) = for t < 



lim fti(t) = 2/ ^H^. 



2tt 



(32) 



From 



»i + / <5«(w) 



dw 
2^ 



(33) 



we finally obtain 

(Ji)o = 





/'OO 






[«?+ 










J — OG 



C W ( W )-2TJ^( W ) ^ (84) 



Since the total rate of dissipation J(t) is the sum of the 
rates of dissipation through the i th degree of freedom 
Ji(t), Eq. JSJ is immediately obtained. 



In Eqs. 10 and (JJJ, when mj = 0, the Langevin equa- 
tion takes an overdamped form: 

7i±i(t) = Fi (x(t)) + + eff(t). (35) 

For this model, the proof of equalities in Eq. (|34|l re- 
quires a special treatment because Cu(0) and Ru(0) 
are divergent in this case. In the following, we 
prove Eq. (|34|l by considering this singularity. In this 
case, we interpret the correlation function as CV,- (t) ee 

([*i(*)-Vi]°[fi(0)-%])o- 

First, by using the Ito formula, the time evolution of 

an arbitrary function A(x(t)) is expressed as 

d a («(«)) = aa (x^+y: ^a( X ( t) ). m±iim , 



dt 
where 



i=0 



JV-l 



i=0 



Fj(x(t)) d + T d 2 
7i 7 l <9x 2 



(36) 
(37) 



is the backward Fokker-Planck operator. In order to solve 
Eq. P6"| , we introduce an operator Q (t) as 



A(x(t)) = G(t)A(x(t )), 



(38) 



where Q(t) is independent of A(x). By substituting 
Eq. I|38|l into Eq. (|36|l . we obtain an equation for Q(t) 
as 



•w. Wt |'<..M!Mil (39) 



dt ' " ^ " ilr, 

A formal solution of Eq. (|39|) is given by 

rt N-i 
, I 



S(<) 



a (t-t )A_ 



(40) 

By setting = Fj(cc), we immediately obtain 

+ / E *«(*-«,*(*))■ [&(») + e/?(*)]<W41) 

J tci A n 



where 



*<,-(t,a:) 



_____ 

7? 




e* A f;(_) for t > 
for t < 0. 



(42) 



By substituting Eq. 141(1 into Eq. 135(1 and averaging it 
with e = 0, it is found that 



lim e<*-*°> A .F i (x(to))=7i€ i 

to — * — OO 



(43) 
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Hereafter, we consider the limit to — > — oo. The sub- 
stitution of Eq. H41|) into Eq. I(35|) leads to the equation 



f t N-l 

x i {t)-V i = / ^ ^(t-a,^)).^-^) +e/P(«)] da, 

•J— OO „_n 

(44) 



3=0 



where 



= < -[*«(t.«) + M(*)] fi»t>o 

fort< 0. 



(45) 



By comparing Eq. with the average of Eq. 144(1 . we 
find 



J2tf(t-*) = <Ay(t- a, *(*))>„. 



(46) 



Henceforth, we discretize the time as t k = kAt with 
an interval At in order to clarify our argument mathe- 
matically. By setting e = 0, the discretized form of the 
Langevin equation ((35(1 becomes 



7iAsf = 



-At + V^A^ 



-O (At 3 / 2 



(47) 



where a; fe = {x k } = {xi(t fc )}, Ax* = x k+1 — x k , and 
AW* = Wi(t k+1 ) - Wi(t k ) (see Appendix 0. Similarly, 
Eq. 1(11(1 is discretized as 

j t (t k )At = F ^ xk+ ^ + F ^ Ax k + o ( At 2) : (48 ) 

where Eq. 1(35(1 and the definition of the symbol o have 
been used. By combining Eqs. W!\ and jlBfr. a straight- 
forward calculation yields 

W» ^^ + T.((^- S ,) 2 ) o -g 

/2T ( [^(a^ 1 ) + F t (x k )] AW k ) Q 



1; 

-O (At 1 ' 2 



2At 



(49) 



For the limit At — > 0, the second and third terms on the 
right-hand side of Eq. 1(49(1 can be transformed as 



lim 



Axl 
At 



2T 
At 



jiC u (u)-2T — . (50) 

Z7T 



do; 



Next, the discretized form of Eq. (|41|l with e — be- 
comes 

oo N—l 

F t {x k ) = HVi + J2J2 ^(^^')v / 2^ A ^' 

1=1 j=0 

(51) 



Hence, the fourth term on the right-hand side of Eq. 1(49(1 
is calculated as 



f2T ([Fi(x k+1 ) + Fi(x k )] AW k ) Q 



2At 



T(<S> tl (At,x k )) , 
(52) 

where the relation (AW k AW!j) = SijSkiAt is used. Ac- 
cording to Fourier's theorem, 



lim 



($ u (At,x k )) + ($ u (-At,x k )) 





/"OO 
















J — oc 



■;Ki^-l ^ (53) 



where Eqs. I|45|) and ((46(1 are used. By combining 
Eqs. lERfll . (JSnj, and we finally obtain the follow- 

ing expression with the limit At — ► 0+: 



r„U)--2TR' il U-) (.VI) 



It should be noted that the integral on the right-hand 
side of Eq. 1(54(1 is convergent in the limit At — > 0+. 
Since the total rate of dissipation J(t) is the sum of the 
dissipation rate through each degree of freedom Ji(t), 
Eq. JSJ) is immediately obtained. 



D. Remarks 

We present several comments on the proof in the pre- 
vious subsections. First, the final result is independent 
of the selected force term Fi(x). In particular, since no 
smallness of the driving forces is assumed in the deriva- 
tion, Eqs. 1(34(1 and ((54(1 hold even when the system is far 
from equilibrium. Their right-hand sides represent the 
extent of violation of the fluctuation-response relation. 
These equalities imply that the rate of energy dissipa- 
tion through the i th degree of freedom is directly related 
to the violation of the fluctuation-response relation for 
this degree of freedom. 

Second, in the overdamped case, we obtain 



: lim i^H 

LJ — >-00 



(55) 



from Eq. 1(46(1 by using lim^^oo 3>ij(uj, x) = 0. It should 
be noted that the inertial effect cannot be observed in 
standard experiments on colloidal systems. Thus, all the 
quantities on the right-hand side of Eq. (0 can be di- 
rectly measured experimentally. 

Third, Eq. ((34(1 can be rewritten in a more compact 
form in the underdamped case. By using Fourier's theo- 
rem and Eq. 1(29(1 . we can calculate R' ii (uj)dcj/2'K — 
[Rii(0+) +Rii(0-)}/2 = 1/(2™,)- Therefore, Eq. 
can be expressed as 



/ / 1' 



T] 



(56) 
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Thus, the rate of dissipation through the i th degree of 
freedom can be expressed as the deviation of the kinetic 
temperature of this degree of freedom from the tempera- 
ture of the heat bath. In the overdamped case, we cannot 
give such an interpretation since the kinetic energy can- 
not be defined. Moreover, for experimental use, Eq. Ij34(l 
is more convenient than Eq. (|56|) . because in many ex- 
periments, accurate determination of the kinetic temper- 
ature requires an extremely fine time resolution. 

Fourth, we demonstrate that the result presented in 
the previous subsections can be generalized further. For 
example, the following quantity 



Iii{t) 
1 



(57) 

«<(*) hjvM - 0(o)] + «<(o) o [ 7jVj (t) - &(«)])„ 



can be rewritten in terms of the fluctuation-response re- 
lation violation as 









roc 








J —oc 



(58) 



CM - 2TRUCJ) 



2^ 



For the underdamped case, Eq. lj5H|l can be obtained by 
substituting Eq. I|27l) into Eq. 158|) and using the lemma 
in Appendix [U] (see Appendix [B] for the overdamped 
case). Since lu(0) = (Ji) , Eq. i(59")l is regarded as a 
generalization of Eq. (|34|l . In addition, the diagonal ele- 
ments of Eq. H58|) are force- velocity correlation functions 
expressed as 

ki{t) = - (vi(t) o Fi{x(0)) + Vi(0) o Fi(x(t))) , (59) 

which is immediately obtained from Eqs. 1|35JI and l|58|) 
with e = in the overdamped case. In the underdamped 
case, Eq. (ISTij) follows from Eqs. J7J and and the fact 
that (vi(t) o Vi(0)) Q — — (vi(0) o Vi(t)) Q . In general, the 
physical significance of the off-diagonal elements of the 
violation has not yet determined. 

Finally, we discuss a relation between Eq. JSJ) and lin- 
ear response theory 0,H3- In this theory, the power loss 
that is proportional to the square of the driving force is 
discussed in terms of the response function. It should 
be noted that the response function considered in this 
theory is defined only at equilibrium. Therefore, this re- 
sponse function denoted by R*f(t) characterizes the lin- 
ear response from the equilibrium state. For example, we 
consider a force model Fi(x) = fi — d Xi U(x), where fi is 
a constant driving force and U(x) is a potential. When 
the driving forces are sufficiently small, we can calculate 
the dissipation rate (linear power loss) from Eqs. (JTJ) and 
(|TT|l and the definition of R^it) as 

JV-l N-l 

( J )o = E E^(°)^ + °(/ 2 )' ( 6 °) 

which is in accordance with linear-response theory [ToL 
l2(il ] . On the other hand, our result in Eq. JSJ is valid inde- 
pendent of the magnitude of the driving forces (It should 



be noted that Rij(uS) in Eq. (JSJ differs from R°j(u>) when 
fi 0)- Hence, Eq. JSJ should agree with Eq. I|6(J|1 when 
the driving forces are sufficiently small. Thus, it might 
be interesting to demonstrate directly the equivalence be- 
tween these two expressions. 



III. OTHER EXAMPLES 

In this section, it is demonstrated that the violation 
of the fluctuation-response relation is related to the en- 
ergy dissipation for the other types of Langevin mod- 
els. We consider the following models: a model with 
stochastically switching potentials, a system driven by a 
temporally periodic force, and a system in contact with 
multiple heat reservoirs. These models were originally 
introduced phenomenologically in order to describe par- 
ticular non-equilibrium phenomena without microscopic 
foundations. In the following subsections, we present a 
method by which Eq. © can be extended to each case; 
this will allow us to examine the relevance of each model 
to describe a certain phenomenon. 



A. Stochastically driven system 

First, a model with stochastically switching potentials 
is considered. For simplicity, we consider a model with 
one spatial degree of freedom. Let x be the position of a 
particle in one-dimensional space. We assume that this 
particle has an internal degree of freedom denoted by a. 
Moreover, let this particle be exerted a potential force 
F a = —d x U a (x) depending on a. Therefore, the model 
is expressed as 

x(t) = v(t) (61) 
mv{t) = -jv(t) + F a{t) (x(t))+m+ef P (t)A&2) 

where m and 7 denote the mass and friction coefficient 
of the particle, respectively, and £(t) represents the zero- 
mean white Gaussian noise that satisfies 



(£(t)£(f)>=27T5(f-f). 



(63) 



As mentioned earlier, ef p (t) is a probe force with a suffi- 
ciently small e. We assume that a(t) is a Poisson process 
in {0, 1}. The transition rates from state to state 1 
and vice versa are denoted by flio(x) and floi(x), respec- 
tively; they can depend on the position x of the particle. 
The following analysis can be extended to the case that 
involves two or more internal states. This type of model 
was originally suggested as the model of a motor protein; 
it was termed flashing ratchet [8J, |9J, |21| . 

For this model, the rate of energy dissipation J{t) is 
defined as 



J(t)At = 



t+At 



hv(s) - ^(s)} o dx(s), (64) 
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where At is an infinitesimal time interval. It has been 
shown that the following equality holds [l8l |22| : 



J(t)At 



t+At 



-v(s) 2 + U <j{t) (x(s)) 



(65) 



[U a( H +0) (x(fi)) - U a(fj _ 0) (x(r 3 ))} 



where e = and f 3 for j = 1, 2, ■ • ■ denotes the time at 
which the transition of the internal state a(t) occurs. The 
summation of the second term on the right-hand side is 
over j that satisfies t < fj < t + At. Since this term can 
be regarded as an energy gain accompanied with state 
transitions, Eq. 1|66|) can be interpreted as the energy 
conservation law in the case of this model. 

Here, we show that the rate of energy dissipation 
J(t) can be expressed in terms of the violation of the 
fluctuation-response relation as 



(J)o 





poo 












J — oo 



C(u) - 2TB! (uj) 



do; 
2^ 



(66) 



where the definition of the velocity correlation function 
C(t) and the response function R(t) are similar to those 
in Eqs. J3J) and ©, respectively. Eq. (|uT)|l is identical to 
Eq. with a single spatial degree of freedom. 

Now, we prove Eq. (|66|l . As in the previous case, 
we study the time evolution of an arbitrary function 
Ar(t) ( x (t), v (t))- First, we fix a trajectory of the particle 



{x(t),v(t)} and a history of transitions represented by t 3 
for j = 1, 2, • • • . For this history, we select a small time 
interval At in which at most one transition can occur. 
Let Z a i a (t\ x{i))At — 1 when a transition from a state a 
to another state a' occurs in the the interval (t, t + At); 
otherwise Z a i a {t; x(t))At = 0. It should be noted that 
the expectation value of Z a i a (t\ x(t)) over the ensemble 
of transition histories for a fixed value of x(t) is equal to 
the transition rate a {x{t)) . 

Then, the time evolution of A a u\(x(t), v(t)) during At 
is written as 

4r(t+At)(*(* + At), v(t + At)) - A <t) (x(t), v{t)) 
= A a{t+At) (x(t),v{t)) - A a{t) (x(t),v(t)) 
+A a{t) (x(t + At),v(t + At)) 
-A a{t) (x(t),v(t))+0(At^ 2 ). (67) 

The first term on the right-hand side can be expressed as 

Ar(W-At) (*(*),«(*)) ~ A a(t) (x(t),v(t)) = 

Sa(t)o [i4i(a;(t),«(i)) - A (x(t),v(t))} Z w (t; x(t))At 
+S a(t)1 [A (x(t),v(t)) - A (x(t),v(t))} Z Q1 (t; x(t))At 
+0(At 3 / 2 ). (68) 

On the other hand, by using the Ito formula, the second 
term on the right-hand side of Eq. I|67|l is expressed as 



A a(t) {x{t + At),v(t + At)) - A a{t) (x(t),v(t)) = 6 a{t)a ,A a ,A a ,(x(t),v(t))At 

a'e{0.1} 

x - d . , . . lx „ V2^TAW(t)+eP(t)At -wo, 

+ J2 S a{t)<T ,—A a ,(x(t),v(t))-^ ±t w + OAt 3 / 2 , 69 

^— ' w ov m 
o-'e{o,i} 

I 

Hence, by combining Eqs. (|BTI) . ll6*5j) . and l(6"9T and taking 
the limit At — > 0, we obtain a general expression of the 
time derivative of A a u\(x(t),v(t)) as 



where A CT denotes the backward Kramers operator corre- 
sponding to each state: 

_ d -jv + F a (x) d 7 T d 2 

A <r= V ^~^ « 1 2^2- ( 70 ) 

ox m ov ov z 



dt 



A a(t) (x(t),v(t)) 



(^o-(t)O <^r(t)l 
+ (^er(t)O $a{t)l 



A -Q w (x(t)) n w (x(t)) 

n i(x(t)) a 1 - n ai ( x (t)) 

m+ef p (t) g f4W<),«(«)) 
m ^ Ai(a;(t),u(t)) 

-Cio(*5 a:(t)) Cio(*;z(*)) 
Cbi(*;x(*)) -Coi(*;a:(«)) 
I 



A {x(t),v(t)) 
A 1 (x(t),v(f)) 



A (x{t),v(t)) 
A 1 {x{t),v(t)) 



(71) 



where £ CT v(t; x(i)) = Z a r a (t; x(t)) — f2 (T / (T (x(f)). The sym- bol • in the last line of Eq. I|71|) implies that ( a > a (t; x(t)) 
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is statistically independent of a(t) (Ito-type definition). 
Next, we introduce an operator Q(t) such that 



By substituting Eq. J77J into Eq. (|50j) . we obtain 



By substituting Eq. Ij72(l into Eq. (|71J) . we obtain an equa- 
tion for Q(t) 



where 



A a{t) (x(t), v(t)) = g(t)A a{to) (x(to),v(to)) (72) "(*) " * = (« - *, *(*). »(*)) ' + e/ P (*)] ds 

J — OO J —OQ 

■({s';x(s'))ds'ds, 

where 

/>oo 

K a (t,x,v) = H(s)$ a {t- s,x,v)ds + H{t). (83) 



tf ( „_,, ( „A +( , ( „».«a±5Cw 

aw m 



v—v(s f ) 

(82) 



(73) 



A = (S a0 S a i) 



A -f2io(x) fiio(aO 

n 01 (af) A x -n i(a;) / I 1 



(74) 



and 



<w(t;x) Cw(t;x) \ ( 1 



Coi(*;aO -Coi(*;») / V 1 



(75) 



The initial condition is Q(to) = 1. A formal solution of 
Eq. J73J) is 

Jto dv m 
+ f g{s)e^-^ A -as;x)ds. (76) 

Jto 

Therefore, the force F a r t ) [x(t)) is expressed as 
F a{t) (x(t)) = e^ A F a{to) (x(t )) 

v=v{t ) 

+ f $>*(s) it - s, x(s), v(s)) ■ [£(») + e/P(«)] ds 

•/to 

+ f e^ A F a(s) (x( S )) 

Jt v=v{s) 



C(s;x(s))ds, (77) 



where 



= J -^e* A F CT (z) for t > 



I o 

Since (C(s, x(s))) = 0, 

lim e(*- i °) A F CT(to) ( a; (to)) 



for t < 



(78) 



t)=u(to) 



7«. (79) 



Henceforth, we consider the limit to — > — oo. 
Next, Eq. (|62[l is formally solved as 



>(t) = I H(t-s)- [F a(s) (x(s)) + £(s) + eff(s)} ds, 

(80) 



where 



for t < 



(81) 



The average of Eq. (|82|l and a comparison with the defi- 
nition of the response function results in 



R(t - s) = (K a(s) (t - s, x(s), v(s))) Q . 



(84) 



The right-hand side is a function of t — s due to the time 
translational symmetry of the steady state. 
Since Eq. I|64fl can be rewritten as 



J(t)At 



t+At 



~/v(s) 2 ds - y/zyfv(s) o dW(s) 



(85) 

we obtain Eq. (|34|l based on an argument similar to that 
in Sec. Ill Bl and by using Eqs. and 



B. Time-dependent system 

We consider a case in which the driving force is time de- 
pendent. For simplicity, only a system with a single spa- 
tial degree of freedom is considered, although the analysis 
presented here can be generalized to a multi-dimensional 
case. The model is expressed as 

±{t) = v(t) (86) 
mv(t) = -~/v(t)+F(x(t),t)+Z(t)+ef p (t), (87) 

where the notations are the same as those in Eqs. (|61f) 
and (|62() . The second term on the right-hand side 
of Eq. 1)8 7|) F(x,t) represents a time-dependent force. 
For example, we might assume that F(x, t) consists of 
conservative and non-conservative parts as F(x,t) — 
—d x U(x) + fit), where f(t) is a time-dependent driv- 
ing force, although the final result is independent of this 
assumption. This model can be regarded as the model 
of macroionic current in the presence of an AC electric 
field; it was also studied in the context of a Brownian 
ratchet pf. 

The rate of energy dissipation is defined according to 
Eq. 16411 . In this case, the law of energy conservation is 
expressed as 



J(t)At = - 



t+At 



-v(s) 2 + U(x{s)) 



/t+At 
f( S ) o dx(s). 
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Since the system does not possess time-translational in- 
variance in the presence of the time-dependent driving 
force, we define the velocity correlation function as 

C(A, t) = ([v(t + A) - v(t + A)] [v(t) - v(t)}) , (89) 

where v(t) = (v(t)) Q is the ensemble-averaged velocity at 
time t. The response function in this case is defined as 



(v(t)) £ -v(t) 



R{t~ s,s)f p (s)ds + 0(e 2 ). (90) 



With this background, we present the equality be- 
tween the rate of dissipation and the violation of the 
fluctuation-response relation: 



(J(t)) = 7 \Ht) 2 + 



C(uj,t)-2TR'(uj,t) 



dw 
2^ 



(91) 

where A(w,t) = J™ oo A(A,t)e wA dA for an arbitrary 
function, A(A, t). Thus, the result can be generalized 
for systems without time-translational invariance. 

We now derive Eq. I|91f) . First, we introduce a new vari- 
able 9 and rewrite Eqs. and (|57Jl in an autonomous 
form as 

x(t) = v(t), (92) 
mv(t) = - 7 v(t)+F(x(t),6(t))+Z(t) + £F(t),(M) 

e\t) = i, (94) 

where 9 (to) = to- By using the ltd formula, the time 
evolution of an arbitrary function, A(x(t), v(t) 1 9(t)), is 
obtained as 



-A(x(t),v(t),9(t)) = AA(x(t),v(t),9(t)) 

+ jL A (x(t),v(t),9(t)) ■ €(t)+£/PW , (95) 
ov m 



where 



ox 



-7« + F(x, 9) d ^ 7 T d 2 
i 2 dv 2 



Ov 



09' 



(96) 



We introduce an operator that is independent of A such 
that 

A(x(t),v(t),9(t)) = G(t)A(x(t ),v(t ),9(t )). (97) 

By substituting Eq. lj§7|) into Eq. l|9"5|l . we obtain a 
stochastic differential equation for Q (t) as 

g(t) = g(t)A+ m + £fP{t) -G(t)^-, (98) 

m ov 

where the initial condition is Q (to) = 1. A formal solution 
of Eq. (EH) is 

g( t ) = e (*-*o)A + f g{ S )^-^ . m±im ds . 

Jt dv m 

(99) 



Therefore, F(x(t),9(t)) can be expressed as 
F(x(t), 9{t)) = G(t)F(x(t ), 0(to))\ v=o[to) (100) 



^-^ A F(x(t ),9(t )) 



v=v(t ) 



+ $(t - a, x(s), v(s),6(s)) ■ + efP(s)] ds, 

Jto 



where 

l_d_ 

${t,x,v,9) = { —fo 




= J 3^^ A F(x, 



for t > 
for t < 



(101) 



By taking the limit to — > — oo, the first term on the 
right-hand side of Eq. I jlOljl converges to a function of t 
only: 



hm e^ A F(x(t ),9(to)) 

Zq — ► — OO 



v=v(to) 



F(t). (102) 



We therefore derive 

jv(t) = F(t). (103) 
A formal solution of Eq. I|87|l is given as 

v(t) = [ H(t- s) ■ [F(x(s), s) + fa) + eff(s)} ds, 



where 



H(t) 



! e -7t/m f 0Tt>Q 
for t < 



1)1 




(104) 



(105) 



By substituting Eq. I|101|) into Eq. 1104|) . we obtain 
v(t)-v(t) = (106) 
K(t - s, x(s),v(s), 9(a)) ■ + e/ p (s)] ds, 

— OO 

where 

K(t,x,v,9) = / H(s)$(t-s,x,v,e)ds + H(t). (107) 
Jo 

The average of Eq. (|107|l yields 

R(t - s, s) = (K(t - s, x(s), v(s),9(s))) Q . (108) 

It should be noted that the s-dependence of the right- 
hand side of Eq. (|108fl is retained after taking the average; 
this can be confirmed from Eqs. (|97|l and l|99|) . 

Since the definition of J(t) in Eq. 164fl can be rewritten 
as Eq. I|85|) , we can obtain Eq. I|91|l based on an argument 
similar to that in Sec. Ill Bl and by using Eqs. I|107|) and 
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C. Multiple heat reservoirs 

Finally, we address systems with multiple heat reser- 
voirs by considering two cases. The first case involves a 
heat bath with a spatially inhomogeneous temperature 
profile. Such a model can be considered as a model of 
thermophoresis; it was first analyzed by M. Buttiker and 
R. Landauer 0,113 ■ In particular, we investigate the 
model represented by Eqs. © and (JJJ. Let the spatial 
profile of the temperature be T(r). In this case, the noise 
intensity 2jiT in Eq. is replaced with 2jiT (r^t(i)) 
for ji = [i /3J . In order to avoid any ambiguity due to 
multiplicative noise, we assume that the model can be 
represented in the underdamped form, i.e., mi 7^ . 

The definitions of the measurable quantities and the 
rate of energy dissipation are the same as Eqs. QJ, J2J, 
©, and (JTTJ. For this case, the following equality is 
derived: 



(Ji) n = 





/■OO 












J —OO 



C u (lo) - 2fiR' u {u>) 



2^ 



(109) 

where Tj = (T (r M (-))) for \i — is the steady tem- 

perature averaged using a steady distribution with re- 
spect to x. Since the proof of Eq. (|109fl is almost similar 
to that in Sec. Ill Bl we have not mentioned it here. 

In the second case, each degree of freedom in a system 
is in contact with a different heat bath of a different tem- 
perature. We reinvestigate the same underdamped model 
described by Eq. JHJ and (Q); however, in this case, the 
temperature depends on the index of the degrees of free- 
dom. Therefore, the variance of £i(t) is considered as 
2~fiTi. The definitions of the measurable quantities are 
identical to ones described by Eqs. (JJJ, (J2J), and ©• The 
definition of dissipation rates is the same as Eq. Qllfl. 

For this model, we can prove the equality 



(Ji)o = H 



C ii {uj)-2T i k ii {uj) 



dw 
2^ 



(110) 



by replacing T with T$ in the proof given in Sec. Ill Bl 

The above argument can be applied to the problem of 
heat conduction. For instance, let us consider the one- 
dimensional lattice heat conduction. We assume Xi{t) to 
be the one-dimensional position of the i th particle, and 
Vi(t) to be its velocity. The force term is selected as 

Fi(x) = —a(xi - it) - b(x l - i£) 3 + c(x i+ i ~ 2x t + Xi-\), 

(111) 

where I denotes the lattice constant and a, b, and c are 
constants. We set x-i = xq and xn = Xn-i- Sites at 
the both ends of the chain are assumed to be connected 
to heat baths of different temperatures as To > TV— 1, 
while the other sites are not connected to a heat bath: 
7i = for i ^ 0,N - 1. Evidently, Eq. (|TTU|l holds 
for this model. Further, — (Jo)q > represents the 
heat transferred from the high-temperature heat bath, 
and (Jjv_i) > represents the heat dissipated into the 
low-temperature heat bath. Due to the energy balance 



in the system, (Jo) + (Jn-i) q — holds. Therefore, 
— (Jo)q (= (Jjv-i)o) represents the heat flux through the 
system. It should be noted that (Ji) = for i ^ 0, N— 1 
in this case. Thus, the heat flux through the system 
is explicitly related to the violation of the fluctuation- 
response relation at the end of the chain. On the other 
hand, the relation between the heat flux in the system 
and the violation of the fluctuation-response relation in- 
side (bulk) the system has not yet been determined. 



IV. CONCLUDING REMARKS 
A. Conclusion 

In this paper, we presented several results with regard 
to the relationship between the rate of energy dissipa- 
tion and the violation of the fluctuation-response rela- 
tion for various types of nonequilibrium Langevin models. 
The most important feature of these results is that they 
enable the determination of the rate of energy dissipa- 
tion based only on experimentally measurable quantities 
and without detailed knowledge on the system. Hence, 
our results provide a proposition that can be experimen- 
tally verified. The experimental verification of the equal- 
ity, when possible, ensures that the system is in fact a 
Langevin-type system, i.e., assumptions (Al) and (A2) 
are acceptable. If the equality cannot be established ex- 
perimentally, it implies the existence of other slow de- 
grees of freedom that were not considered. Hence, the 
equality presented in this paper serves as a "check sum." 

The present result is also suitable for practical use. If it 
has been already established that the system in concern is 
well described with a Langevin model, Eqs. and j^jjl 
will provide a measure of the contribution of each degree 
of freedom to energy dissipation. An advantage of our 
result is that we do not require the detailed knowledge 
on a system to determine the rate of dissipation. This 
enables the determination of the relative importance of 
each degree of freedom in a complicated system from the 
viewpoint of energetics. 



B. Suggestion of experiments 

In order to demonstrate the above mentioned concepts, 
we suggest a possible experiment on a motor protein. 
Y. Okada et al. reported that a motor protein termed 
KIF1A, a single-headed kinesin superfamily pro tein, can 
be modeled as a flashing ratchet model [2l], |26j . This is 
because the microtubule exhibits a quasi one-dimensional 
periodic structure on which a KIF1A molecule moves 
processively and KIF1A has two internal states, strong 
and weak binding states, according to the chemical state 
of the nucleotide hydrolyzed in the molecule. Okada et 
al. explained the results of single-molecule experiments 
using a flashing ratchet model by adopting several fitting 
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parameters |26j . However, the relevance of these param- 
eters has not yet been experimentally confirmed, because 
of certain difficulties in experimental techniques. 

If the argument that the KIF1A molecule can be de- 
scribed as a flashing ratchet is valid, Eq. I|66l) should hold 
for this molecule according to the result in Sec. lIII Al As 
mentioned above, Eq. Ij66|l can be verified without spec- 
ifying the model parameters such as the profile of peri- 
odic potentials. The right-hand side of Eq. (|66|l might 
be determined by employing the present techniques of 
the single-molecule experiment. On the other hand, the 
rate of chemical free energy consumption by the motor 
molecule can be estimated by means of biochemical tech- 
niques. If these quantities are in agreement, the relevance 
of a Langevin-type model to this molecule is quantita- 
tively ensured. In other words, only the center of mass 
is the slow variable for this molecule, and it contributes 
to energy dissipation. However, if the right-hand side of 
Eq. Ijtjtil) is less than the rate of chemical energy input, 
it implies the existence of more degrees of freedom that 
should be considered and that the flashing ratchet model 
is inappropriate. 

Moreover, the experimental determination of (J;) for 
the center of mass of the protein using Eq. (|rJrj|> reveals 
the amount of chemical energy input that is converted 
into the translational motion of the motor molecule. 
Since the question "how much chemical energy is con- 
verted into mechanical energy?" is one of the most im- 
portant problems regarding a motor protein, such an ex- 
perimental study will serve to answer it. 



C. Future perspectives 

Finally, we present future theoretical problems for con- 
sideration. First, although our argument began with the 
Langevin equations, it should be possible to derive the 
same result by beginning with a microscopic mechanical 
model that satisfies the fundamental assumptions (Al) 
and (A2). This will not only provide another perspective 
of the problem but will also help to generalize the frame- 
work of the theory. We remark that a simple case has 
been analyzed quite recently |27l |. 

Further generalizations of Eq. JSJ for cases that are not 
considered in the present paper might be possible. For 
example, it might be interesting to consider a case with 
a finite-time correlation of noise (generalized Langevin 
equation 0) based on our framework. The effect of hy- 
drodynamic interaction between particles requires careful 
consideration. Because the hydrodynamic effect may be 
crucial for applying our theory to macromolecules P"t| 
such as biomolecular machinery, we should examine this 
problem in greater detail. 

Since our theory is based on the assumption of the 
separation of time scales, it cannot be applied to cases in 
which the separation of time scales is not distinct. For 
example, our theory currently does not cover an atomic 
level description of traditional nonequilibrium systems 



such as shear flow systems, heat conduction systems and 
electric conduction systems. Even in such a case, we be- 
lieve that we can obtain some information on a system by 
quantifying a degree of fluctuation-dissipation violation. 
More research is required in this regard. 
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APPENDIX A: FLUCTUATION-DISSIPATION 
THEOREM 

In this appendix, we derive the fluctuation-dissipation 
theorem for the case of equilibrium. Although the follow- 
ing argument is applicable to the overdamped system, it 
can be extended to the underdamped case without much 
difficulty; both cases yield the same result. 

Let x = (xo,--- ,xn-i) be a set of dynamical vari- 
ables under study. Let the evolution equation of Xi be 
expressed as 

lMt) = -^gM + e/?(i) +&(*), (Al) 

where sff(t) denotes a small perturbation force and £j(i) 
represents Gaussian white noise that satisfies 

{ti(t)SiV))=*yiT6i j 5(t-t). (A2) 

The initial condition of Xi(t) is set at t = — oo. 

In this model, the response function Rij (t) is defined 

as 

r oo N-l 

(±i(t)) e =e ^i? y ( S )/P(t- S )d s + 0( £ 2 ). (A3) 
Jo i=o 

It should be noted that Rij(t) = for t < due to the 
causality. Since Rij(t) does not depend on the selection 
of {fj(t)}, it can be determined by considering a special 
situation in which ff(t) = 1 for t > and ff{t) = for 
t < 0, only for a specific value of j. In this case, Eq. (|A3|) 
becomes 

(±<(t)>*. =ej^ R ij (s)ds, (A4) 

where ( )* r ^ denotes the average for this situation. 

Then, by defining the time-correlation function of ve- 
locity as 

C y (t)^W°^(0)) O ' (A5) 
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the fluctuation-response relation implies 

C ij (t) = T{R ij {t)+R ji {-t)). 



(A6) 



In the following, first, Eq. (|A6|) is proved by focusing on 
the single component case (N = 1). Next, a conven- 
tional derivation without mathematical rigor is briefly 
discussed, which might be useful to argue physical prob- 
lems. Finally, the generalization of the proof to the multi- 
component case is explained briefly, since it is straight- 
forward. 



1. Discretized form 

As observed in Eqs. JUJ and C(0) and R(0) 

are divergent. Therefore, in order to state the theorem 
described in Eq. i|A6|l without ambiguity, we investigate 
the discretized form of Eq. (|A1|) : 



7(x fc+1 - x k ) 



dU(x k 



j-^At + ^[¥fFAW k + ef k At 

(A7) 



da; 

-0({Atf' 2 



where At represents the time interval of the discretiza- 
tion; we set 7 = 70, x k = x (kAt), AW k = W((k + 
l)At) - W(kAt), and f k = f p (kAt). Further, AW k 
obeys the Gaussian distribution with 



(A^AW 1 ) = S a At. 



(A8) 



It should be noted that in Eq. I|A7(1 . the estimation 
AW k = O^At) 1 / 2 ) is assumed, which is expected from 
Eq. EBJ. 

In this discretized model represented by Eq. HA7jl. the 
time correlation function C k is defined as 



At 



At 



(A9) 



Similarly, by discretizing Eq. 1A4() . the response function 
R k is defined as 



x k — x k 1 
At 



tr fe-1 

= e^AtR l , 



(A10) 



where f k = 1 for k > is assumed. Therefore, the 
fluctuation-response relation in Eq. (| A6|) should be re- 
garded as the continuum form of the relation 



C k = T , Rk + R - 



(All) 



in the limit At — > 0, k — > 00 for fixed kAt. Moreover, 
R k = for k < 0, C° = 2Ti?° for k = 0, and C k = TR k 
for k > 0. 



2. Proof of Eq. f£TTt 

First, from Eqs. (|A^|) and (|A10jl . Eq. IjAlljl is explicitly 
written as 



„fc ^.k-l 



At 



fe-i 



+0(e 2 ), 



x l+1 — x l x 1 — x° 



At At 





(A12) 



where 9 k = 1 for k > 1 and 8° = 1/2. The following is a 
proof of this expression. 

The transition probability P £ (x k — > izi fc+1 ) from a; to 
x fc+i ^£ Qr ^ > 0) is determined from 



F £ (a; fe -> x k+1 )dx k+1 = d{AW k ) 



I (Aiy fc ) 

e 2At 



2vrAt 



(A13) 

By using Eq. (|A7(I . this transition probability is calcu- 
lated as 



k _^ ,r. fc +i\ — 



(A14) 

E J At+0((At) 3 / 2 )J 



y n^At 

Based on the estimation 

U(x k+1 ) - U(x k ) = (A15) 

it is confirmed that 

P £ (x k ^x k+1 ) _ 

e -/3[C/(x fc + 1 )-C/(x fc )-e( 2; fc + 1 -a ; fc )]+0((At) 3 / 2 )_ ( M6 ) 

Since an initial condition is imposed at t = —00, the 
(k+ l)-time probability distribution function at time t = 
t for I = 0, 1, • • • , fc is expressed as 



k-l 



P e {x\--- ,x k )=p c (x a )l[P E ( 



x l -> 



where p c {x) is the canonical distribution 

Pc(x) = le-™. 
The key identity to derive Eq. (|A11(I is 

P e (x°, ■ ■ ■ ,X k ) _ E /3(x fe -x°)+O(i;*L (At) 3 / 2 ) 

P e (x fc ,--- ,z ) 



(A17) 



(A18) 



(A19) 



which is easily obtained from Eq. (|A17|) and Eq. I|A16(I . 

Since £f =0 (Ai) 3 / 2 -> m the limit At ^ 0, A: ^ 00 for 

fixed kAt, the term 0(E/=o( At ) 3/2 ) in Ec l- P^l 1 can be 
neglected. 
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The left-hand side of Eq. I|A12() is evaluated as follows. 
First, using the key identity Eq. I|A19[) . we calculate 

[ Y[dx l P e (x ,--- ,x k )(x k - x*- 1 ) 

1=0 

= f\{Ax l P e {x k 1 --- 1 x ){x k -x k - 1 ) 

J 1=0 

k 

= ~ Jt[dx l P e (x ,--- , 3 *)(x 1 -x°)e- e "' y 



1=0 



= -Jf[dx l P £ (x° 



1 ■) ' 



'^(x 1 - x°){l - ep(x k - x )) 



1=0 
-2\ 



+0{ef). (A20) 
By setting k — 1 in this expression, we obtain 

J dx°dx 1 P s {x°,x 1 )(x 1 -x°) (A21) 

= ie/3 J dx°dx 1 P (x°,x 1 )(x 1 - x ) 2 + 0(e 2 ). 

Next, Eq. I|A20(I can be rewritten as 

f Y[dx l P E (x ,--- , x k ){x k -x k ~ l ) = 

J 1=0 

ep f Y[dx l P (x ,--- ,x k )J2( xl -x°)(x l ' +1 -x l ')d l 



2^ 



+0(s 2 ) 



(A22) 



By dividing both sides by At, Eq. (|A12(I is obtained. 

Detailed balance It should be noted that Eq. (|A19|) 
is essential to derive the fluctuation- dissipation relation. 
The condition in Eq. (|A19|) implies a time-reversal sym- 
metry expressed as 



P (x u ,--- ,x") = P (x»,--- ,x u ) 



(A23) 



it is referred to as the detailed-balance condition. In gen- 
eral, if this condition does not hold for a system without 
a probe force (e = 0), the fluctuation-response relation 
cannot be derived. In fact, for models studied in this pa- 
per, this relation does not hold in nonequilibrium steady 
states because the detailed balance is violated. 



3. Conventional derivation 

When the mathematical rigor is not seriously cared, 
the fluctuation-response relation of Eq. I|A6() can be 
quickly derived by employing the path integral represen- 
tation: 



T([x]) = 
ifexp 



(A24) 



A 

47 



jx(t) 



dU(x(t)) 
dx 



e/P(t) dt 



where T([x]) denotes the probability density of trajectory 
x(t), < t < t, provided that x(0) is given; if is a 
normalization constant. By denoting the time reversed 
trajectory of x(t) by x(t) — x(r — t), we obtain 



T([x]) 
T([x}) 



exp 



,/VM_ £/ P (i)|di 



(A25) 

Using this equation, the following identity is obtained for 
an arbitrary quantity A([x]): 



(A) = J V[x]p c (x(0))T([x])A([x]) 

= f V[x] Pc {x{Q))T{[x])e-P e $o ^mrW A{[x\) 
: u'-' 1 ' (A26) 



where A([x\) = A([x}). By setting A([x}) = x(t)\ t = T , 
we obtain the equality C(i) = TR(t) for t > 0. This 
corresponds to Eq. (|A6() for N = 1. 



4. Multi-component case 

By introducing discretized variables x k — {x k } = 
{xi(kAt)}, < i < N — 1, the proof described in Ap- 
pendixes IA II and IA 21 can be generalized to the multi- 
component case. When only the j th probe force is ap- 
plied from t = (/?(*) = 1 for t > and /?(*) = for 
t < 0), Eq. (|A19|) becomes 



= e ef3{x k 3 -x J )+O{T.'; =Q (&tf> 2 ) 



(A27) 



P E ,j(x k ,--- ,x°) 

where P e j(x°, • • • , x k ) is the joint probability distribu- 
tion in the presence of the above mentioned probe force. 
Then, the following identity is obtained: 

/ndx^Or ,... 1 x k )(x k ~x k - 1 ) = 
J 1=0 

e(3 f ndx'Po^ , ■ ■ • , x k ) J2(xl - x?)(x< +1 - x^O 1 



1=0 

-2\ 



1=0 



+0(e z 
By defining 



ij \ At At 



(A28) 



(A29) 



and 



4 - *r 

At 



fe-i 



= e^A^ i , (A30) 



1=0 



Eq. (|A28|) leads to 



S~1K rp tj 



k ok 



(A31) 
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for k > 0. Since Cf. = , this relation is written as 

1 J J' 



(A32) 



O i ■ - 1 (Km + H H ) 



for all k. By taking the limit At — > 0, we obtain Eq. i|A6() . 

A matrix representation can be used in the multi- 
component case. Let C(t) and lZ(t) be the matrices whose 
(i, j) components are Cij(t) and Rij(t), respectively. Us- 
ing these matrices, Eq. (|A6|) is expressed as 



C(t) =T{K{t)+n\-t)), 



(A33) 



where the symbol * represents the transpose of the ma- 
trix. From this equation, the following relations are de- 
rived with regard to the symmetric and antisymmetric 
parts of the matrices: 

C s (t) = T(TZ s (t)+TZ s (-t)), (A34) 
C a (t) = T(ll a (t) -K a (-t)), (A35) 

where the symbols s and a denote the symmetric and 
antisymmetric parts, respectively. 



APPENDIX B: QUICK DERIVATION OF THE 
EQUALITY 

Based on the path-integral argument presented in Ap- 
pendix we can simplify the derivation of Eq. JSJl. In 
this appendix, we do not consider the mathematical rigor, 
although the following argument can be made more pre- 
cise by employing the discretization argument, as shown 
in Appendix IA II For simplicity, we consider the case 
with a single degree of freedom without the inertia term. 
The generalization of the argument to multivariable and 
underdamped cases is straightforward. 

We analyze the Langevin equation 



7 ±(t) =F(x(t))+£(t)+eP(t), 



(Bl) 



where £(t) denotes the zero- mean white Gaussian noise 
that satisfies 



(B2) 



The probability of a trajectory [x] = {x(t)}, to < t < t\ 
for x = xq at t = to is expressed as 



V[x]P(x \[x}) = V^]Ke-^^^- F ^-^ P ^ 2dt , 

(B3) 

where if is a normalization constant. By using this prob- 
ability, we obtain 



x(t)) £ = / V[x]P(x \[x])x(t), 



for t <t<tx. From Eq. (Eg) , 

6(x(t)) £ (3 



8{ep{s)) 2 7 



x(t)o[ 1 x(s)-F(x(s))]) £ 



(B4) 



(B5) 



Based on the definition of the response function, the left- 
hand side of Eq. I|B5() is identified as R(t— s) in the limit 
e — > 0. Therefore, in this limit, 

R(t - s) = | [« 2 + C(t -s)]-^ (±(t) o F (x(s))) Q . 

(B6) 

By exchanging t and s in Eq. (|B6|I and adding the result- 
ing expression to Eq. (B6j), we obtain 



R(t -s)+R(s-t)=P [v 2 + C(t - s)] 



(x(t)oF(x(s)) + x(s)oF(x(t))) .(B7) 
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Since the last term on the right-hand side of Eq. (|B 
becomes (J) when t = s, Eq. (JSJ is obtained. 



APPENDIX C: DERIVATION OF LEMMA 

For an arbitrary non-anticipating function A(t) 0, the 
following relation holds. 

1. When t < t N , 



A{t N - s) ■ dW(s) o dW(t) ) 
to J I o 

= (A(t N -t)) dt. (CI) 



2. When t = t N , 



A(t N - s) ■ dW(s) ) odW(t)\ 

= i(A(0+)) di. (C2) 



3. When t > t N , 



A{t N - s) -dW(s)) odW(t)\ =0. (C3) 



Proof 

We discrctizc the time interval (to,t^) as to < t\ < 
ta < ■ • • < tjv-i < tN- In the following, the symbol ~ is 
used to imply equality in the limit of N — > oo. Further, 
we use the notation, AW k = W(t k+1 ) - W{t k ). 

1. When t < t/V) tk can be considered such that t = t k . 
By discretizing the left-hand side of Eq. I|C1|I , we obtain 
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A(t N -s)-dW(s) 



'to 



dW(t) 



A(t N - s) ■ dW(s) + [ A(t N - s) ■ dW(s) 



odW(t k ) 



A(t N - s) ■ dW(s) + / A(t N - s) ■ dW(s) 



to 



AW f 



J to 

t N l>t N 

A(t N - s) ■ dW(s) + / A(t N - s) ■ dW(s) 

tk+1 Jtk 



AW 



fe-i 



5^ A(t N - t t )AW l + A(t N - t t )AW l 



1=0 



1=0 



AW k 



N-l 



N-l 



A{t N - U)AW l + A (tN - k)AW l 



U=k+1 



l = k 



I 

AW k 



(C4) 



r 



Since A(t) is a non-anticipating function and that AW k By considering the limit N — > oo, we obtain Eq. (|C1|) . 
is independent of AW 1 when k ^ I, Eq. ilC4(l can be 
written as 



A(t N - s) ■ dW(s) 



■ dW{t) 



^A(t N - t k )AW k AW k + ^A(t N - t k )AW k AW k 



(A{t N -t k )) ({AW k f) 

(A(tjy — t k )) Q (th+1 — tj). 



2. For t — t^, we define t^+i such that dWit^) ~ 
W(tN+i) — W(tif). By discretizing the left-hand side of 
(C5) Eq. 1221, we obtain 



A(t N - s) ■ dW(s) 



to 



■ dW(t) 



A{t N+1 - s) ■ dW(s) + / A(t N - s) ■ dW{s) 
to J to 

N N-l 

k 



AW 



N 



J2 MtN+i ~ t k )AW k + - tk)AW 

I 



.k=0 



k=0 



AW N ) . (C6) 
/ o 



Since Ait) is a non-anticipating function and that AW k By considering the limit N — > oo, we obtain Eq. (|C2|) . 
is independent of AW 1 when k ^ I, Eq. (|CJ4|) can be 



written as 



A(t N - s) ■ dW(s) 



1 



odW(t)\ 
/ o 



2 (^(*jv+i - *iv)) ((AW ) } 

i (A(t N+1 — t N )) (t N+1 — t N ). (C7) 1 7v < t: hence, Eq. ljC3() is obtained immediately. 



3. For t > ijv, dW(t) is independent of dW(s) for s < 
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